arXiv: 1504.00681 v2 [cs.DS] 6 Apr 2015 


Approximation of non-boolean 2CSP 
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Abstract 

We develop a polynomial time n(-^logi?) approximate algorithm for Max 2CSP-i?, the 
problem where we are given a collection of constraints, each involving two variables, where each 
variable ranges over a set of size R, and we want to find an assignment to the variables that 
maximizes the number of satisfied constraints. Assuming the Unique Games Conjecture, this is 
the best possible approximation up to constant factors. 

Previously, a l/i?-approximate algorithm was known, based on linear programming. Our 
algorithm is based on semidefinite programming (SDP) and on a novel rounding technique. The 
SDP that we use has an almost-matching integrality gap. 
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1 Introduction 


We study Max 2CSP-i? problems, that is constraint satisfaction problems with two variables per 
constraint, where each variable can take values from a finite set S of size R, and the goal is to find 
an assignment to the variables that maximizes the number of satisfied constraints. For example the 
following is an instance of Max 2CSP-3 where S = {0,1, 2}, with three variables and five constraints 


Xi + X 2 = 1 mod 3 
{X 2 = 0) V (Xi = 1) 

^2 = ^3 

Xi + W 3 = 2 mod 3 

The above instance is satisfiable, as witnessed by the assignment (Xi, X 2 , X 3 ) = (0,1,1). 

We devise a polynomial time hi approximate algorithm based on semidefinite program¬ 

ming. Previously, the best approximation for this problem was 1/R, based on linear programming 
|STX98] . 

The performance of our algorithms is best possible up to multiplicative constants and assuming 
the Unique Games Conjecture. Max 2LIN-i? is the special case of Max 2CSP-i? in which every 
constraint is of the form Xi — Xj = bij (mod ii); The results of Khot et al. [KKMOOT] imply that 
there are constants ci,C 2 such that it is UG-hard to distinguish Max 2LIN-i2 instances in which 
at most a Cl/R fraction of constraints are satisfiable from instances in which at least a C 2 /logi? 
fraction of constraints are. We discuss in the Appendix how to derive the above hardness as a 
corollary of results in [KKMOOT] . 

Chan |Chal3j shows that there is a constant C 3 such that for every e > 0 and every sufficiently 
large R, it is NP-hard to distinguish (1 — e)-satisfiable instances of Max 2CSP-R from instances 
in which at most a c^logR/y/R fraction of constraints are satisfiable. Chan’s hardness result is 
the strongest known result for nearly satisfiable instances of Max 2CSP-i?, and it remains an open 
question whether it is possible to achieve an approximation ratio significantly better than logR/R 
on such instances. 

As we discuss in the Appendix, it follows from results of Khot and Vishnoi |KVn5| that the 
Semidefinite Programming relaxation that we use has a Q{R /(log R)‘^) integrality gap, which almost 
matches our algorithm. 

1.1 Other related previous work 

Previous algorithmic and complexity-theoretic work on Max 2CSP-i? has been motived by the Slid¬ 
ing Scale Conjecture, the Unique Games Conjecture and the question of Approximation Resistance. 
We summarize the main known results below. 

The Sliding Scale Conjecture 

The approximability of Max 2CSP-|S| is closely related to the power of PCP systems where the 
verifier makes two queries and each query is answered by an element of S. In particular, if we denote 
by PC Pc^s[0 {\og n),2,R] the set of languages that admit a 2-query PCP system with completeness c, 
soundness s, randomness 0(log n), and answers coming from a set of size R, then we have that Max 
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2CSP-i? has a polynomial time r-approximate algorithm if and only if PCPc^s[0{log n), 2, R] = P 
for all c, s such that s/c < r. 

(A strong form of) the Sliding Scale Conjecture, formulated by Bellare et al. [BGLR93] is that 
Max 2CSP-i? is NP-hard to approximate within a factor even when R is polynomially related 

to the number of variables and constraints. 

Chan’s result on 2-query PCPs [Chal3] implies that, for constant R, the hardness of approxi¬ 
mation grows with R as The reduction establishing the hardness of approximation runs 

in time 2 *^^'^) • and so, under the assumption that NP does not have sub exponential 

time algorithms, it establishes a n{R^^‘^/ log R) hardness also for super-constant R, up to R being 
roughly logarithmic in the number of variables. Raz’s parallel repetition theorem establishes the 
NP-hardness of approximating Max 2CSP-i? within a factor of for an absolute constant e > 0, 
and the reduction runs in time establishing a hardness results for larger values of R, up 

to ^ for every <5 > 0 . 

Approximation resistance 

Hastad |Has08| proved that Max 2CSP-R problems are never approximation resistant. Given an 
instance of Max 2CSP-i2 in which every constraint has R? — t satisfying assignments, Hastad’s algo¬ 
rithm gives a 1 — -^- 1-0 (^ niiogR ^ factor approximation, which is better than the worst-case approx¬ 
imation ratio provided by picking a random assignment. Note that, for instances whose constraints 
have few satisfying assignments, Hastad’s algorithm does not improve the l/R-approximation factor 
mentioned above. 

Unique games 

A Unique Game is an instance of Max 2CSP-i? in which every constraint is of the form x = 
f{y), where x and y are variables and / : S —>• S is a bijection. Feige and Reichman [FR04] 
prove that there is a constant <5 > 0 such that it is NP-hard to l/R^-approximate Unique Games. 
Khot’s Unique Games Conjecture [Kho02| concerns the approximability of Unique Games in nearly- 
satisfiable instances, and there has been considerable algorithmic work devoted to testing the 
limits of the conjecture. Charikar, Makarychev and Makarychev |CMM06] give a polynomial time 
algorithm that, given a (1 — e)-satisfiable instance of Unique Games satisfies a 

y 1 y/elogR) ^ \^/log rJ j 

fraction of constraints. Using the fact that a random assignment satishes a 1/R fraction of con¬ 
straints, one can see that the best between the outcome of the algorithm of Charikar et al. and 
a random assignment achieves a H(logi?/(i?loglogR)) approximation for Unique Games. The 
rounding technique developed by Charikar et al. is tailored to Unique Games problems and, while 
it can be adapted to “/c-to- 1 ” constraints, it seems necessary to adopt significantly different ideas 
when working with general 2CSP problems. 
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1.2 Our Techniques 

Our polynomial time H (-^ log R) approximate algorithm for Max 2CSP-i? is based on semidefinite 
programming. Before describing our semidefinite programming relaxation, we note that we can 
assume without loss of generality that all constraints are of the form (Xj = a) A {Xj = b) and have 
exactly one satisfying assignment 0 

Given an instance of Max 2CSP-i? with variables ranging over a set S of size i?, in the semidef¬ 
inite programming relaxation, we have a vector Xi^a for each variable Xj and for each value a G S, 
with the intended meaning that Xi^a is of unit length if Xj = a and Xi^a is of length zero otherwise. 
This is a standard approach when formulating SDP relaxations of problems in which we have to 
model non-boolean assignments to variables, such as graph coloring problems and unique games. 
The relaxation is 


max ^ {xi,a,Xi^b) 


C=(Xi=a)A(Xj=b) 


S.t. 


Ealkhaf = 1 

Mi 

{Xi,a,Xi^b) = 0 

Mi,Ma 7 ^ b 

{Xi,a,Xj^b) > 0 

Mi,jMa,b 


To see that the above SDP formulation is a relaxation, consider an assignment (oi,..., a„) to 
the variables (Xi,...,X„) of the constraint satisfaction problem; we can turn it into a feasible 
solution for the SDP by fixing a unit vector xq and then letting Xj^Q. = xq and Xj^a = 0 for every i 
and for every a ai. We can see that such a solution is feasible and that the objective function is 
equal to the number of constraints satisfied by (ai,..., an)- 

Before discussing our rounding algorithm, let us first see a simple rounding that gives a 1/R 
approximation. Given a solution of the SDP, we pick a random assignment for the variables Xj, 
by assigning each variable Xj independently, and by giving to Xj the value a with probability 
proportional to ||xj^a||- That is, we create a random assignment Zi,..., Zn where the Xj are 
independent and 


Pr[Xj = a] := 


Xi 




Note that, by Cauchy-Schwarz we have 


^lkj,fe|| < VR- j^\\xi,b\\‘^ = Vr 
fees Y ^6^ 

Then the probability that a constraint (Xj = a) A {Xj = b) is satisfied is 

Pr[(Xi = a) A {Zj = 6)] > > ^{xi^a,Xj,b) 

^The reduction from general instances to such instances is standard and simple: given an arbitrary instance 
I of Max 2CSP-it we can replace each constraint of I the form f{Xi,Xj) — 1 having s satisfying assignments 
{(oi, bi),..., (os, fy)} with the s constraints (Xi = ai) A (Xj = 6i), .. ., (Xi = as) A (Xj = fy); if we call I' the new 
collection of constraints generated by this substitution we see that every assignment satisfies the same number of 
constraints in I as in I'. 


3 







where we used Cauchy-Schwarz again. Note that right-hand side is at least a l/i? fraction of the 
contribution of the constraint to the cost function, and so the rounding satisfies, on average, a 
number of constraints that is at least a 1/i? fraction of the SDP value. 

The above analysis is tight if all vectors have length and if Xi^a and Xj^t, are parallel, 

which means that in order to improve the 1/R approximation we need to devise a different rounding 
scheme. 

A typical approach to round SDP formulations like ([T]) is to pick a random vector g from a 
Gaussian distribution and assign to Xi the value a such that {xi^a,g) is largest, or to pick a random 
value a among those for which the inner product is larger than a certain threshold. The problem 
with this approach in our context is that if, say, ||xi,a|| = R~'^ and the assignment 

Xi = b might be exponentially (in R) more likely than the assignment Xi = a, even though 
constraints that require Xi = a give a contribution to the cost function that is polynomially (in 
R) related to the contribution of constraints that require Xi = b. This issue is related to the fact 
that rounding algorithms such as the one of Charikar, Makarychev and Makarychev work only in 
instances in which a large fraction of constraints are satisfiable. 

We develop a different type of rounding scheme, that we believe is new. For each vector Xi^a we 
compute a probability pi^a, proportional to the length ||xj_a|| which is a “target probability” with 
which we would like to have Xi = a. Then we compute a threshold ti^a such that, if is a standard 
normal distribution, 

Pr[A^ > ti,a] = Pi,a 

Finally, we pick a vector g such that each coordinate of <7 is a standard normal distribution, and, 
ideally, we would like to set W = a if and only if 


9) — ll^i,a|| 't 


i,a 


an event that, indeed, happens with probability pi^a- Unfortunately, for the same Xi, we can have 
the above event hold for more than one value of a. We resolve this ambiguity by creating a short 
list Li of all the values a for which the above event holds, and then by picking randomly from the 
short list. 

This way we construct a random assignment {Zi ,..., Zn) in which each Zi takes value a with 
probability proportional to ||xi^a||, and such that the events Zi = a and Zj = b are positively 
correlated if the angle between Xi^a and Xj^a is small. 

We describe our rounding algorithm more precisely in Section [2l The analysis of the rounding 
algorithm relies on two key lemmas, showing, for each constraint {Xi = a) A (Xj = b), a lower 
bound to the probability that a ends up in the shortlist Lj and b ends up in the shortlist of Lj 
(this is proved in Section |4]) and an upper bound to the size of the shortlists (proved in Section [5]). 
Proving the two key lemmas requires several facts about the behavior of Gaussian vectors in certain 
conditional distributions, and we develop the required theory in Section [3l 


2 The Rounding Algorithm 

We start by assigning a probability 


Pi,a 


^ / I \^i,a \I 

^ r) 


( 2 ) 
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to each variable Xi and each value a. This is similar to the probability ||a^*,a||/— 
ll^^i.all/V^ in the naive rounding described in the introduction, but for technical reasons it is 
convenient to make sure that the probabilities are always at least n(l/-R). Note also that the 
probability are always at most IjyfR. 

Then we define the threshold ti^a as the number such that, if is a standard normal distribution 
we have 

Pr[A^ > ti,a] = Pi,a 

Note that = 0(Viog A:)- 

Note also that for a Gaussian-distributed vector g (that is, a vector such that each coordinate 
is a standard normal distribution) we have that 

Pr[(5)®i,a) — ||^i,all ' Ai,a] Pi,a- 

The rounding algorithm selects a ’short-list’ Li of possible assignments for each variable i, by 
picking one Gaussian vector g, and defining for each i the list Lj by 

Li ■— {o . {Xi^ai9) — ||^j,a|| ' 

The final assignment Zi for the Pth variable is chosen by selecting an element of Lj at random (no 
assignment is chosen if Lj is empty). 


2.1 Analysis of the Algorithm 

Our analysis will proceed via the following two results. 

Lemma 1. For every i ^ j and every values a, b, 

Pr[a G Lj A 6 G Lj] > ^(logL) • • {xi^a,Xj^b) 

JrC 

Lemma 2. There is a constant U such that for every i ^ j and every values a, b, 


PrllLjl < U A \Lj\ <U\a£LiAb£ Lj] > 11(1) 

We prove Lemma [1] in Section 0] and Lemma [2] in Section [5l The approximation follows easily 
from them. 


Theorem 3 (Main). The rounding algorithm achieves an Ll (-^logi?) approximation ratio. 

Proof. If we let Zi,..., Z^ denote the randomized assignment created by the rounding algorithm, 
we want to show that the expected number of constraints satisfied by the assignment is at least an 
Ll{\og R/R) fraction of the optimum of the SDP, and hence at least an id{logR/R) fraction of the 
optimum of the 2GSP-i? problem. 

It is enough to show that, for every constraint C of the form (Aj = a)A{Xj = b), the probability 
that the constraint is satisfied by the algorithm is at least an Q{R~^ log R) fraction the contribution 
of the constraint to the objective function, that is, 


Pv[Zi = a A Zj = b] > Q 



{Xi,ai Xj,b) 


( 3 ) 
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Which follows by observing that 


Pr[Zj = a A Zj = b] = Pr[Zi = a A Zj = b\a G Lj A 6 £ Lj] ■ Pr[a G Lj A 6 € Lj] 

( log- \ 

—^ j • {xi^a,Xjfi) ■ Pr[Zj = a A Zj = b\a e Li Ab e Lj] 


— I j ' \Xi,aj Xj^h) 


by Lemma [T] and Lemma [2j 


□ 


3 Gaussian Estimates 


In this section, we state and prove some facts about Gaussian Distributions which we use in the 
proofs that follow. 

Definition 4 (Normalized Gaussian vectors). A random variable g ~ A^(0,1) with normal distri¬ 
bution, zero expeetation, and varianee 1 is ealled a normalized Gaussian variable. A normalized 
Gaussian veetor in M" is a random variable g with values in M"' whose eoordinates are independent 
normalized Gaussians. 


The following simple claim is well known. 

Claim 5. If g is a normalized Gaussian veetor in M” then {g,u) is a normalized Gaussian variable 
for any unit vector u G M"". 

Definition 6 (Gaussian vectors in a subpace). Let V G ML be a subspaee. A normalized Gaussian 
vector in V is a random variable g with values in V such that {g, v) is a normalized Gaussian 
variable for any unit vector u G P. 

It is easy to verify the following. 

Claim 7. Let V G be a subspace, and let g be normalized Gaussian vector in V. Then for every 
unit veetor u G {g,u) is a normal random variable with mean zero and varianee at most 1. 

Definition 8. We define the funetion p : M ^ M by p{t) = Pr[g' > t], where g is a normalized 
Gaussian random variable, p is the complement to 1 of the eumulative distribution function for the 
Gaussian distribution. 


The following is a well known bound on p{t). 

Claim 9. (Gaussian Approximation) Let g be a standard normal random variable. Let p{t) = 
Pr[g' > f\. Then or any t G R, 


n 



< 


V^{t‘^ + 1 ) 


e < p{t) < 


_J_ -ty2 

V^t 


The proof of the above claim can be found, for example, in |CMM06] . Lemma A.l. 
Claim 10. There is a constant to such that for every t > to, y < In ^ 
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Proof. This follows immediately from Claim [9j 


□ 


We next present two key claims. 

Claim 11. (Lower Bound for Change in Probability) There is a constant to such that for every 
t >to and a G [0,1] 

p((l - a)t) = Pr [5 > (1 - a)t] > a ■ p{t) ■ In 

Proof. Let D{a) = p{{l — a)t) — ap{t) In We will show that D{a) > 0 for all a G [0,1]. 

We observe that D{0) > 0. Using the fact that p{t) = e~’^^ 1‘^dr and taking the derivative 

with respect to a, we will show that the derivative in question is non-negative, thus the function is 
monotone increasing, which implies that D{a) > D{0) > 0. 


—D{a) = — 
da da 


' e '^^/‘^dr ] — p{t) In 

^/^ ^ ^ vif) 


pit) 


y/^t 




t 




t 

''7^' 


=-P /2 


> 


y/^t yp^ 


^g-P/2g-«2tV2g«P_^g-iV2 




-P/2 j'g-a2tV2g«P _ > 0 


Here, the first inequality follows from claim [9] above, the second inequality follows from claim 
m and the last inequality follows from observing that, for a < 1, we have 


a 


H‘^12 < af => 


□ 


Claim 12. (Upper Bound for Change in Probability) 

There is a constant Iq such that for every t > to and a G [0,1], 

p{{l-a)t) <p{tp-^^\ (4) 

Proof. Let D{a) = —p((l — a)t) + p{tp~^°‘\ We will show that D{a) > 0 for all a G [0,1] and 
t > to. We observe that 11(0) = 0. Using the fact that p(t) = JP e~^^t‘^dr and taking the 
derivative of D(a) with respect to a, we will show that the derivative in question is non-negative, 
thus the function is monotone increasing, which will imply that D(a) >11(0) = 0 and will complete 
the proof . 
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1 


da 




e-^"/^dr + In 


pit) 


> - 


t 


V 27r 

^3 2 -(l-3a)tV2 1 _^ 

-2 V^(i + 1) 


-{\-OL)‘^t^ 12 


t 


=-iV 2 


>- 


i 


3i 


2(i + l) 


g3ai2/2 _ ^ctt^-oPt^/2 


,-iV2 j'g3aiV2 _ gai2-a2t2/2^ > Q 


here, the first inequality follows from claim fTOl the second inequality follows from claim [9] and 
the last inequality from the observation that 

3ai2/2 ^ at^-cdt^l2 


□ 


The following claim is an easy corollary of Claim fT^ 

Claim 13. For t > 1 and a < -p, p{{l — a)t) < O (pit)). 

Proof. Using Claim W2[ it is enough to show that p{t)~^^ < 0(1)- But this is clear from the bound 
p{t) < ^— and the bound on a. □ 

Claim 14. Let u,v G be unit vectors such that {u, v) > 0, and let g be a normalized Gaussian 
vector in M”. Then for any ti,t 2 > 0, Pr [{g, u) > ti and {g, v) > t 2 \ > p(ti) • p(^ 2 )- 

Proof. The inner products {g, u) > ti and {g, v) > are normalized Gaussian variables. The claim 
follows since because (u, v) > 0, the correlation between these Gaussian variables is non-negative. 
We omit the simple details □ 


Claim 15. Let u and v be two unit vectors in such that {u,v) > 0, and let g = (< 71 , 52 ) £ be 
a random vector whose coordinates are independent normalized Gaussians. Also let ti,t 2 I be 
thresholds such that ti <t 2 < 4ti. Then 


Pr [max{ 51 , 52 } > 5ti |(5,ui) > ti and ( 5 ,^ 2 ) > t 2 ] < 1/2. 

Proof. Using Bayes’ law we have 

Pr [51 > 5ti and {g,ui) > ti and ( 5 ,^ 2 ) > 12 ] 


Pr [51 > 5ti |( 5 ,ui) > ti and ( 5 ,^ 2 ) > 12 ] = 


< 


Pr [( 5 , ui) > ti and {g, U 2 ) > t 2 ] 
Pr [51 > 5ti] 


Piti)pit2) 
^ P(5ti) ^ 1 


(by Claim fTll) 


p{At 


ij 


^Alternatively, one can embed the quadrant {xi > ti} fl { 0:2 > ^ 2 } into the event in question via a measure 
preserving map 














where the last inequality is by Claim [9l The same computation also bounds 

Pr [g 2 > 5ti I {g, ui) > ti and {g, U2) > t2] by and we get the desired claim using the union bound. 

□ 

The following is an immediate corollary of Claim [T^ 

Claim 16. Let u and v he two unit vectors in such that {u,v) > 0, and let g = {gi,g 2 ) £ 1^^ be 
a random vector whose coordinates are independent normalized Gaussians. Also let ti,t 2 I be 
thresholds such that ti <t 2 < 2ti. Then 

Pr [\\g\\ > lOti \{g,ui) > ti and ( 5 ,^ 2 ) > ^ 2 ] < 1/2. 


4 Proof of Lemma [T] 

In order to proof Lemma [1] we need the following result. 

Lemma 17. Suppose that pj^ > Pi^a- Then 

Pr[6 G Lj\a G Li] > Ll{cos{9) ■ Pjb ' In (-)) 

\Pj,bJ 

where 9 = 

Proof. By definition, pj^b > Pi,a implies that ||xj^b|| > ||xj_a|| and > tj,b, where > fI(^log 
and tj^b > chosen so that 


and 


Pr \a G Lj] = Pr 


Pr \b G Lj\ = Pr 


{^,,9)>U,a 


> tj,b 


= Pi,, 


Pj,b 


Here g is our random gaussian. 

Let g = 5 f|| + g_\_+ go where is in the direction of g_\_ is in the direction perpendicular to 
Xi^a in the plane spanned by Xi^a and Xj^b and go is perpendicular to the plane spanned by Xi^a and 
Xj^b- Denote by 9 the angle xfffffxf^b and note that since, by the SDP constraints, (xi^aiXj^b) > 0 it 
holds that cos{9) = {xi^a,Xjfi) ■ n^. | uu., || > 0. 
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Pr[6 € Lj\a G Li] =Pr 
= Pr 


/ ^7 b ^ 

> tj,b 


\\Xjfi 

Xjfi 


{^,,9)>ha 


I 


\ / ^jb \ 

,9\\} + ( ,|J’ || ,g±) > tj^b 


= Pr [||fi'||l|cos(6») + \\ 9 ±\\sin{e) > tj^b 
>Pr [cos{ 6 )ti^a + \\ 9 i.\\sin{ 6 ) > 

= PT[cos{e)ti^a + \\g±\\sin{9) > tj^b] 
>Pr [cos{9)tj^b+ \\g±\\sin{9) > tj^b] 
'1 — cos{9) 


= Pr 


Il5±ll > tj,b 


sin{9) 


{ 


^i,c 


> ti^a] 

^ ^7,a] 


^ 9\\) > ti 


Where the last inequality follows from the fact that ti^a > tj,b and cos{9) > 0. 
We now observe that 

1 — cos{9) _ 1/(1 — cos{9)f‘ _ ■\/{l — cos{9)) 
sin{9) 1 - cos{9Y a/(1 + cos{9)) 

<a/1 — cos{9) < 1 — - cos{9) 
and we can write the expression above as 


Pr[6 G Lj\a G Lj] > Pr 


llfi'xll > tj,b 



Using claim [TT] 


Pr[5 G Lj\a G Li] > Ll{cos{9) ■ pj^b ■ In 



Now we are ready to prove Lemma [TJ 

Proof of LemmaUl Without loss of generality we can assume pj^b ^ Pi,a- Then 

Pr[a G Li A 6 G Lj] = Pr[a G Li] ■ Pr[6 G Lj | a G Li] 
Using Lemma dZl the above is at least 

Pi,a • Q{cos{9) ■ pi b • In ( — )) 

\Pj,bJ 


where pi,a > Pj,b > In = ^(logL), and 

{Xi,ai Xj^b) 


cos{9) = 




□ 
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Putting everything together gives us 


Pr[a e Li Abe Lj] > 

K 

which completes the proof. □ 

5 Proof of Lemma [2] 

For the proof of Lemma [2] we need to bound the increase in probability that a Gaussian variable 
passes certain thresholds, when the thresholds are lowered. This is done in the next lemma. 

Lemma 18. Let be positive thresholds with values between t mw S> 1 and tmax; such 

that Ylb=iPi^b) < 1; (^nd let tmax and tmin be the maximum and minimum of those thresholds 
respectively. Also, let Sb be positive advantages, and set ^h- Then for any I G (0,1), 


R 


'^P{tb - Sb) < 


b=l 


^ D I ^ I 


( 5 ) 


Proof. For all b denote ab = so Sb < Oibh for all b, and also 


R 

E 

6=1 


«b = 


(imin)" 


( 6 ) 


We thus have 


R 


R 


- Sfo) < ^p((l - a6)4)- (7) 

b=l b=l 

To bound ([7|) we partition the summands on the right-hand side according to the value of 
Small Ob’s. Let Is = \b : ab < By Claim [T3l 

l,Cmax; J 


R 


^p((l - ab)tb) < O <0 1 = 

fee/s \b&Is ) \6=1 


( 8 ) 


Large a^’s. Let = {b : Ob > T}. Since any probability is at most 1, 


< 


^p((l - ab)tb) < \h\ ^ 

yt • tminj 


b&h 


(9) 


where we have used ([6]) to bound \I(\ 
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Medium Ufe’s. Let Im = ^ ^ By Claim [12] we get 


p((l - ab)tb) <0 Y I ^ O 


b&Ir, 


,belrr 


Pitn 




Y 


bSlrr 


< o 


P{tn 


Pitr, 




m I — 


< o 


p(tmin) • {t max) 


p{tn 


\3i 


(tmmY 


(10) 


where to bound 11^1 we used the fact that all a^’s in it are at least ^ w together with dOj). 
Combining the inequalities ([8|) , dOj) and (fTOl) , we have dSj) . □ 

We are now ready to prove Lemma [2] 


Proof of Lemma{^ Let g be the Gaussian vector used for the rounding algorithm, and let us write 
it as <7 = 5 || + g±, where g\\ G span and g± € span Note that Lemma [2| 

follows easily from the following two claims; 


Claim 19. 


and 


Pr 


ll^ril II > 20Y^logii |a € Li and b G Lj 


< 1 / 2 , 


( 11 ) 


Claim 20. For any vector h G span {xj^a, such that ||/i|| < 20\/log R, 

IE [|Lj| + |Lj| I 5r|| = /i] < 0(1) 


( 12 ) 


(the identity of g\\ already determines whether or not a £ Li or b £ Lj, and therefore once we 
condition on g\\ = h there is no need to also condition on those events). We present the proofs of 
those two claims in the appendix. Using the above claims the proof is complete. □ 

Proof of Claim 1191 Let ti^a and tj^b be the thresholds used by the rounding algorithm to determine 
if a G Lj and b £ Lj respectively, and assume without loss of generality that ti^a is the smaller of 
the two. By the definition of the rounding algorithm, we know that the thresholds and tj^b-, 
as well and other threshold t used by our rounding, satisfy ^ < p{t) < ■^. It then follows from 
Claim [9| that these thresholds satisfy 


In particular, we have < tj,b < By the SDP constraints, we know that {xi^a,Xjfi) > 0. We 
also know that g\\ is a normalized Gaussian in the span of these two vectors. Hence by Claim [T6l 


< Pr 


Pr 

X 


> 20-\/log R la G Lj and b £ L 


> 10ti,a |(9||, II '’°|| ) > U,a and 


Xjfi 


\Xj,b\ 


>t 


j,b 


3 

1 

< - 
“ 2 


□ 
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Proof of Claim We will show that E [\Lj\ | = /i] < 0(1), as the bound on the conditional 

expectation of |Lj| is identical. By linearity of expectation, 


E [l^jl I 9\\ 


R 


R 


/i] = ^ Pr [6 E Lj I 5|| = h] = ^ Pr 


b=l 

R 

^Pr 

b=l 


{9±, 


^j,b 

\^i,b I 


) + {h, 


b=l 


^j,b 
\^i,b I 


, ^ i h \ 

(9, TTZ^) > h,b 




) ij,b 



^j,b 

"rj.6ll 


has a 


Since g± is a normalized Gaussian vector in a subspace. Claim [7] implies that {g±, 
normal distribution with zero mean and variance bounded by 1. We therefore have that, denoting 

R 

E[\Lj\\ g\\ = h] <J2pih,b- Sb) ■ (13) 

b=l 


We woud like to now bound this sum using Lemma [TSl As we already noticed in the proof of 
Claim [T9l all the are in the range between tmin > ^^ 2 ^^ and tmax < 2^^/Iog~R, such that 
p{tmin) < and p(tmax) ^ 2 ^- H also follows from the SDP relaxation constraints that the 

vectors Xj^b are orthogonal, and therefore ^b — II^11^ — 400log ii. Finally, the choice of 

the thresholds tj^b of the rounding algorithm ensures that Yl^=iP{tj,b) = 1- We can thus use the 
parameter ^ = .1 in Lemma [TSl and get 


(HI < 


(^min)^ 


_ ^ ( 1 P(^min) • {t max) 

it: 


<o 1 + 


p{E 
. (logi?)2' 


= 0 ( 1 ), 


as we wanted. 


□ 
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6 Appendix 

6.1 Integrality gap 

Khot and Vishnoi |KV05| describe an integrality gap instance for a semidefinite programming 
relaxation of Unique Games. Our relaxation, applied to Unique Games, is the same as the one 
studied by Khot and Vishnoi. We will refer to the full version of |KV05] . which is available online 
as a preprint [KV13| . We need to slightly change the analysis of the “completeness” step, which is 
not optimized for the case of highly unsatisfiable instances in |KV13| . 

In the following, we refer to the cost of an assignment or of an SDP solution as the number of 
satisfied constraints (respectively, the value of the objective function) divided by the total number 
of constraints. 

The construction of |KV13| is parameterized by a value rj, that we will set to ^ ^ ^^ . In the 

proof of |KV13l Lemma 3.6], Khot and Vishnoi prove that every solution satisfies at most a 

j^l-2/{2-2ri) ^ ^-l+(2-4r,)/(2-2r,) 

fraction of constraints, which, by our choice of rj, is at most 

R-i • = ^-1 . ^i/iogi? ^ ^ 

R 
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Then they describe a feasible solution for the SDP relaxation and prove that it has cost at 
least 1 — 9r]. We need to argue the stronger fact that their solution has cost at least (1 — 27/)^. 
Khot and Vishnoi first describe a solution that satisfies all constraints except the {xi^a, xj^) > 0 
nonnegativity constraints, and then obtain a feasible solution by taking a tensor product of each 
vector with itself. 

Before taking the tensor product, one can see that the cost of the solution is times the 
expectation of the inner product (x, y) where x, y are in { — 1,1}^, x is uniformly distributed, and y 
is obtained from x by, independently for each coordinate f, setting yi = Xi with probability 1 — rj and 
yi = —Xi with probability t]. The expectation is clearly R- (1 — 2r]) and so the cost of the solution 
is 1 — 2r]. After taking the tensor products, the cost of the solution is times the expectation of 
((x,y))^, where x,y are distributed as above. Here we use the fact that > (EA)^, and so the 
cost of the solution is at least (1 — 2r?)^. 

Since we set ry = | — the cost of the solution is l/4(logi?)^. 

In conclusion, we have an integrality gap instance in which the true optimum is at most e/R and 
the optimum of the SDP relaxation is at lest l/4(logi?)^, for an integrality gap of D(i?/(log 


6.2 UGC Hardness that Matches our Algorithm 

In this section, we show that the following 

Claim 21. For every R > 2, every 0 < p < 1 and every e > 9, it is UGC-hard to distinguish 
instances of Max 2LIN-R in which at least a D(l/logi?) fraction of constraints are satisfiable, from 
instances where at most a 0(1M) fraction of constraints are satisfiable. 

We use the following result from Khot et al. [KKMOOTl Theorem 9, Section 6.3], who show that 
for every R > 2, every 0 < p < 1 and every e > 0 it is UGC-hard to distinguish instances of Max 
2LIN-i2 in which at least a p + R~^{1 — p) — e fraction of constraints are satisfiable, from instances 
where at most a R-Ap{R~^) + s fraction of constraints are satisfiable; in the above expression Ap(x) 
is a function that is defined in |KKMO07[ Definition 8, Section 4.2]. 

In the same paper, they give the following bound on Ap{x), which we repeat here for complete¬ 
ness. 


Corollary 22. (IKKMO07 . Proposition 1, Section 6.3]) Let ip{x) = ^ the Gaussian 


density funetion. Let t = t{x) be such that p{t) = x, where, as in Glaim 0 p{t) = ip(x)dx is 
the Gaussian tail probability funetion. Then for any x E [0,1/2) and any p = p{x), p E [0,1] the 
following holds: 


Ap{x) < {l + p)‘i^p{t 




t y 1 + p 

Proof. (Of Claim [2T1) In order to prove claim fT\\ we set p = 1/12 log i?, and x = 1/R. Using the 
estimates from claim [9] we obtain < 0{p{t)), which, from the corollary above, implies 


Al/121ogR(l/^) < 0 {p{t)) -piti 


'1 - 1/12 log i? 
1 -h 1/12 log i? 


Using Claim [121 we have the upperbound; p{t^J~J^) < p{t^/\ — 2p) < p{t{l — 4p)) < 
We conclude that 


Ai/i2iogK(l/i?) < 0(p(t)) < 0(l/i?2 = 0{1/R^) 
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By using |KKMO07l Theorem 9, Section 6.3], we obtain that it is UGC-hard to distinguish 
between the case where at least n(l/logi?) fraction of constraints are satisfiable and the case 
where at most R ■ 0{1/R?) = 0(l/i?) fraction of the constraints are satisfiable, which concludes 
the proof of the claim. □ 
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